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Abstract 

Children's interpersonal cognitive problem-solving skills 
may be related to their social adjustment; if so, specific 
interventions could increase both such ski lis and 
adjustment . M^^t^ - r. nalyses were performed to examine 
reported relationships between interpersonal cognitive 
p-.^oblem-sol ving skills and adj ustment , and reported 
&££Bat.a of training. Boundary conditions were also 
examined . 
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Interpersonal Cognitive Problem Solving: A Meta- Analysis 

Fostering social competence and behavioral adjustment 
has been a focus of many recent research efforts; 
psychologists have, through a variety of interventions, 
attempted to ameliorate, or even prevent, maladjustment. In 
one such 1 ine of research , investigators have demonstrated 
that there are distinct differences in the way adjusted and 
non-adjusted individuals conceptualize and solve 
interpersonal problems, from preschool age through adulthood 
(e.g., Spivack, Piatt, & Shure, 1976). \ 

The differences between adjusted and non-adjusted 
persons which appear in this research are evident for the 
following cognitive processes: (a) generation of numerous 
alternative solutions to interpersonal conflict situations; 

(b) adequate specification of particular means that may be 
necessary to achieve the chosen solution; and 

(c) consideration of the consequences of one's social acts, 
for oneself and othc-^rs . It is the previously mentioned 
investigators' theoretical position that these inte>rpersonal 
cognitive problem-solving (ICPS) skills are antecedent to, 
and thus mediate, social competence and behavioral 
adjustment. 

For example, it is thought that a child who can 
formulate many alternative ways of dealing with othars can be 
flGxiblej, that one who plans his or her actions through 
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means-end thinking and can weigh pros and of the effects 

of diffferent interpersonal acts (consequents. 1 thinking) is 
less likely to make impulsive decisions anc" more likely to 
act appropriately in social situations (to ^e benefit of 
both parties). He/she elso suffers less frustration through 
use of efficient interpersonal cognitive problem-solving. 
Simply put, socially competent behavior is seen as a direct 
function of these cognitive problem-solving processes- 
Finding d if f erences in these processes between 
adjusted and non-adjusted individuals was theoretically 
and practically encouraging. Such possible linkages 
between cognitive processes and behavior adjustment have 
motivated researchers to develop ICPS training programs 
designed to improve children's social competence v;hether 
children are at risk, behavior disordered, or "normal." 

Further, extensive ICPS training studies have 
indicated that interventions based on teaching these 
specific skills to children increase not only these 
particular problem-solving skills, but also ratings of 
behavioral adjustment, for example, those made by 
teachers. In fact, Shure and Spivack have repeatedly 
demonstrated a direct 1 inkage between increased 
interpersonal cognitive problem-solving skills ands 
positive change in behavior ratings (Shure & Spivack, 
1979, 1980, 1982) . 
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M<4ny attempted replications and extensions of these 
findings have followed these reported successes; however, 
few have been as successful as those of the above ^roup, 
in either substantiating the connection between 
ICPS skills and adjustment, or the salutary Gffe:ctB of 
training. Thus, despite a large body of research, 
questions remain regarding these two fundamental 
assertions . 

A primary difficulty in arriving at unequivocal 
conclusions regarding these assertions arises from the 
question of how best to integrate findings from disparate age 
groups, outcome measures, and research designs. It would 
appear that meta-analytic techniques (see Glass, McGaw, & 
Smith, 1981) be helpful in integrating findings of studies 
within this domain, and in suggesting needed research. 

A meta-analysis is a quantitative integration of the 
results of independent experiments. One begins a meta- 
analysis oy systematically searching for all potentially 
relevant studies that are related for the following reasons: 
they share either a common conceptual hypothesis, the same 
methodology, and/or the same definition of independent and 
dependent variables. Meta-analysis results in a single set 
of numbers describing and evaluating the body of literature 
selected . 
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Thu3 the purpose of this paper is to report the finding 
of five meta-analyses assessing the relationship among 
ICPS skills, <:raining, and behavioral adjustment. Five 
hypotheses, all directional, were examined by the meta- 
analyses performed. They are as follows: 

( 1 ) Adj usted children score higher on interpersonal cogniti 
problem-solving measures than non-adjusted children; 
V 2) Children trained in interpersonal cognitive problem- 
solving skills .demonstrate a higher level of these skills at 
post-test than do no-treatment controls; 

(3) Teachers' post-test behavior ratings for trained 
children are more positive than those for control 
children; 

(4) Social behaviors which are observed at post-test are 
more positive for trained than control children; and 

(5) A direct relationshio between increased ICPS skills 
and improvement in behavioral adjustment can be 
substantiated . 

Method 

A large number of studies were identified for 
possible inclusion in the meta-analyses- Following 
previously listed guidelines, the independent and/or 
dependent variables, as v^el 1 as conceptual premise, had to 
be similar to those ufied in Spivack and Shure's research 
in order for a study to be included here. In addition. 
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any study meeting the above criteria was included if its 
dependent variables were based on naturalistic behavior 
observations or simulations. Although few studies of 
interpersonal cognitive problem-sol ving include such 
behavioral validation, it is vital to evaluating both the 
theory and its applications. Moreover, studies were 
included only if subjects were in early or middle 
childhood. 

Procedure 

The analyses performed for each hypothesis included, 
meta-analytic statistics and procedures as follows (see 
Cooper, 1979) : 

(1) Stcuffer's z, an unweighted or weighted combination of 
probabilities involving the retrieval of the z-scorea 
corresponding to the calculated p level for each effect 
examined. The p for the overall Stouffer z describes the 
likelihood that results could have been generated by 
chance; that is, it describes the confidence with which we 
can state that an effect exists. 

(2) Failsafe number (Rosenthal, 1978, 1979), which is the 
number of studies with non-significant findings (hence, 
kept in one's file drawer!) that would be needed to 
reverse a conclusion that an effect does indeed exist. 
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This is more or less a bench mark which also allows one to 
compare the strength of effect exhibited aginot 
completeness of reviewer's sampling procedure. 
(3) d index, which tells how far apart the means of two. 
groups, experimental and control, are in terms of their 
common standard deviation, independent of sample size. 

(4> y , an index which describes the same quality as does 

3 

the d index, but with more intuitive appeal, was 

calculated for each study. LJ tells by what percentage 

3 

the smaller-meaned group is exceed by the average person 
in the larger -meaned group. This index is derived 
directly from d (Cohen, 1977). 

(5) Lastly, N (Vecchio, 1983) was calculated for each 
n 

hypothesis to guard against Type I error. This index is 

essentially a comparison point for the Failsafe N. 

If the failsafe number is less than or equal to this index 

(5n 10), we know we are in danger of rejecting a true 

s 

H if we assert that an t^ffect exists. 
O 

Results 

A summary of the results of the five meta-analyses 
can be seen on Table 1; more detailed results appear in 
Tables 2-6- 
Th e meta-analysis examining the first hypothesis . 
that adjusted children score higher on ICPS measures than 
non-adjusted children, revealed a highly significant 
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Stouffer z and a large Failsafe N. Thus we can say that 

this effect does exist, and by referencing the effect size 

^ cl = .72) and U , we can say that the effect is large in 
3 

practical terms. That is, the average adjusted child 
scored higher than the 75th percentile of the non-adjusted 
group. We can therefore say that scores on ICPS measures 
do differentiate between adjusted and non-adjusted 
children . 

The meta-analytic results for the second hypothesis, 
that training increases ICPS skills, indicate that thi:^'^^^ 
Gff^ct does exist (see Stouffer's z and Failsafe N), and 
is large enough to be of practical significance. It 
appears safe to conclude that trained children do exhibit 
significantly more ICPS skills at post-test than control 
children. To this extent training is effective. 

The meta-analysis of results of studies which examine 

the impact of training on teachers' behavior rating 

reveals that the effect (that trained chi Idren are rated 

higher than control children at post-test) does exist. 

However, the Failsafe N computed indicates the possibility 

of a file-drawer effect; it is also telling the calculated 

reference index is larger than the Failsafe N. Further, 

the magnitude of the effect, as evidenced by the d index 

and y , is small. overall, these findings indicate that 
3 

caution should be used in assuming that the behavior of 
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children trained in ICPS skills will be more favorably 

raced by teachers than the behavior of untrained children. 

The results of the n^eta-analysis investigating the 

hypothesis that the observed behaviors of trained children 

are more positive than those of control children indicates 

that there is a reliable difference between these two 

groups (see Stouffer z and Failsafe N)- However, the 

magnitude of the difference between trained and control 

groups is not large, and the Failsafe N is not as 

convincing as those for H and H (N is close to it, as 

1 2 n 

well). 

Findings for the final hypothesis indicate that an 
increase in ICPS skills is reliably paired with 
improvement in rated behavioral adjustment- The practical 
magnitude of this effect is, however, not large. In 
essence, the small magnitude of this particular effect 
casts further doubt on the appl ication of this theory. 

Boundary Conditions 

The above results, while enlightening, describe main 
effects only; they summarize the body of literature 
involving ICPS in children. It may be, however, that 
interactions within these meLii effects exists^ such as 
relationships between effect sizes and study 
characteristics. With this possibility in mind, age, 
specific ICPS measures, source of investigation, length of 



11 



ICPS Meta-Analyaia 

11 

intervention, normal /aberrant subject classification, and 
type of intervention were examined to determine whether 
they exerted an effect on d indices in the various 
hypotheses (see Table 7 for boundary effects results). 

It does appear that a larger effect of training is 
seen where alternative generation (rathsr than 
consequential or means-end thinking) is measured, as shown 
by protected t-tests. Age, however, exerts no main effect 
on d indices, and there is no Age X Type of Skill (e.g., 
alternative thinking , means - end , consequential ) 
interaction. 

Source of investigation is a highly significant 

boundary condition (p < .01) for the question of whether 

ICPS skills are generally related to adjustment; the 

Spivack/Shure group has been most likely to obtain 

positive findings. For H , whether training positively 

2 

effects ICPS skill, Spivack and Shure group findings are 
greater than those of all groups except researchers from 
the University of Rochester. 

No other study characteristics were significant 
boundary conditions.' It would seem important, however, to 
more specifically investigate, in future research, the 
effect of length and type of intervention, and whether 
aberrant students profit more from training than do normal 
ones. Aggregation of the few studies that address these 



12 



ICP£ Meta-Analysis 

12 

issues shows effects which approach significance. Longer 
training generally effects teachers' behavior ratings 
positively, for many possible reasons due to various 
curriculum components. 

Lastly, a small subset of studies involving only 
special populations was examined (e.g., learning disabled, 
retarded, emotionally disturbed students) While average 
effect sizes wliich were retrievable closely mirror 
findings for the five meta-analyses discussed here, sample 
size iir^^iRvall in these studies, quality was questionable, 
and variability of effect size was extremely high. Some 
of the better research of this genre, however, finds that 
interpersonal cognitive problem-solving training merely 
"loosens the tongues** behavior disordered students (Camp, 
Blom, Herbert, & VanDoorninck, 1977; Sharp, 1981). They 
give Many alternatives, but quite aggressive ones. 
Thus , closer investigation of the appl ica ti on of 
interpersonal cognitive problem-solving training for 
special populations, as well as specification of needed 
modifications for such populations, is necesary . 

Impl ica t ions and Cone 1 us ions 

The five meta-anlyses performed here indicate that, 
in general, the model and interventions del i nested by 
Shure and Spivack do show reliable effects across studies. 
These effects are, however, not always large, especially 



ICPS Meto-Analysis 

13 

regarding the effects of ICPS training on rated or 
observed behavior adjustment variables. As these are 
presumably the "bottom line" questions for both the theory 
and its applications, continued replication and refinement 
is necessary • 
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Table 1 

Suinmari^^Statiatical I Dterperaonal^Cogni ti ve^Problem 



Meta- N Stouffer's 2 Weight.ed g Fail- Mean U 

study 2 
analysis 2 2 safe effect 

no . 



ICPS/ 11 6.89 
adjustment 

Training/ 18 10.50 
ICPS skills 

Training/ 6 2.99 
beh . rating 

Training/ 6 5.93 
beh . obs . 

Direct 8 5.54 

Biediat ion 
a 

N ( Vecchio, 1983) 
b n 
Sigma 

d 



.000 7.15 .000 182.46 0.72 74 . 7?^ 

a b 

(65) (0.63J 

.000 9.56 .000 716.10 0.75 75.0^ 

(95) (0.58) 

.001 4.58 .000 13.80 0.21 58 . 0?c 

(40) (0.43) 

.000 3.11 .001 71.91 0.43 66. IX 

(40) (0.28) 
000 4.61 .000 82.86 0.47 SS.SX 

(50) (0.29) 
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Table 2 

Meta-ana lyaia_One 

Pl2^i§2l§9iYing_Scores_of _ Adjust ed_and_^ 

a 

Author Year N One-tailed z ^ M Direction 

3 

E ) 

Enright 1980 40 .05 1.64 0.58 71.9 ^ 
et al. 

Gillespie 1982 32 .113 -1.21 -0.7?. 61.0 
et al . 

McKim 1982 67 .0125 3.03 0.61 72.9 ^ 
et al . 

Pellegrini 1980 100 .00025 3.48 0.85 80.2 

Rickel & 1982 95 .125 1.15 0.16 56.3 ns 
Burgio 

Sharp 1981 107 .425 0.19 0.29 61.4 ^ 

Shure 1973 257 .00025 3.48 1.32 90.6 ^ 
et al . 

Shure & 1972 108 .00025 3.48 1.77 96.1 ^ 
Spi vack 

Shure & 1982 113 .00025 3.48 1.43 92.3 ^ 
Spi vack 

Shure 1971 62 .00025 3.48 1.02 84.6 ^ 
et al. 

Swanaon 1980 22 ' .250 0.68 0.12 54.8 ^ 
& Siegel 

(table continued) 
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a 

Direction: = consistent with hypothesis 

ns = non-significant difference between groups 
= not consistent with hypothesis 
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Table 3 

if f §9t_of _Training_on_Children^a_Pro 

Author Year N One-tailed z d U Direction 

3 

B 

Allen 1976 119 .00025 3.48 0.86 80.5 ^ 

Benaky 1978 36 .125 -1.15 -0.15 44.0 

Elios 1980 158 .00025 3.48 1.03 84.8 ^ 

Enright 1980 24 .05 1.64 0.56 71.2 ^ 

Enright 1980 38 .05 1.64 0^45 67.3 ^ 

Gesten 1982 133 .00025 3.48 0.64 73.9 ^ 

et al. 

Houtz & 1976 135 .0025 2.81 0.53 70.2 ^ 

Feldhuaen 

•> 

WcClure 1978 89 .50 0.00 0.05 52.0 ns 

et ai. 

Poitraa- 1977 20 .05 1.64 0.58 71.9 ^ 

Martin 

et al. 

Rickel 1983 54 .0375 1.78 0.41 65.9 ^ 

et al. 

Sharp 1980 54 .08 1.41 0.36 62.0 ^ 

Shure & 1975 235 .00025 3.48 0.54 70.5 ^ 

Spivack 

Shure & 1977 40 .00025 3.48 1.51 93.4 + 

Spivack 

(table continued) 
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Author 



Year 



One-tailed 



20 



y 

3 
(X) 



Directions 



Shure & 
Spivack 

Shure 
et al. 

Stone 
et al . 

Weiaaberg 
et al. 

Weissberg 
et al. 



1980 219 



1972 



94 



1975 144 



1981 563 



1981 243 



.00025 3.48 



.00025 3.48 



.00025 3.48 



.00025 3.48 



.00025 3.48 



1.00 84.1 



2.00. 97.7 



0.70 75.8 



1.95 97.4 



0.50 69.1 



Direction: = consistent with hypothesis 

ns = non-significant difference between groups 
- = not consistent with hypothesis 
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Table 4 

5§t5Z5D5lXsia_Three 

iff§9t_of _Training_on_Teacher^s_Ratinga_o 



a 

Author Year N One-tailed z ^ U Direction 

3 



1980 53 .125 -1.15 -0.15 44.0 

Gesten 1982 133 .0125 -2.24 -0.43 33.4 

et al . 



Sharp 1981 35 .125 1.15 0.19 57.5 



ERiC 22 



na 



Shure & 1982 219 .005 2.60 0.45 67.3 

Spivack 

Weiaaberg 1981 563 .00025 3.48 0.68 75.2 

et al . 

Weiaaberg 1981 243 .00025 3.48 0.55 70.0 ^ 

et al. 

a 

Direction : = consistent with hypothesia 

ns = ncn- significant difference between groups 
- = not conai stent with hypothesia 
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if f §et_of _Training_on_Obseryational 



a 

Author Year N One-tailed 2 d US Direction 



Gesten 1982 261 .00025 3.48 0.87 80.3 

et al . 

WcClure 1978. 185 .025 1.96 0.38 64.8 

et al. 

Rickel 1983 54 .75 1.44 0.33 63.8 

et al. 

Sharp 1979 107 .25 0.68 0.00 50.0 

Weissberg 1981 563 .000025 3.48 0.49 68.7 

et al. 

Weissberg 1981 243 .00025 3.48 0.49 68.7 

et al. 

a 

Direction: = consistent with hypothesis 

ns = n on -significant difference between groups 
- = not consistent with hypothesis 



ns 
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Table 6 

Meta-anal yaia^Five 

B§l5tion§hiB^Between_Change_in_Pr 
lD_§§h5vi2r§l_Adjuatinent 



Author 


Year 


N 


One- tai led 
B 


z 


d 


y 

3 
<?c) 


Direct 


El las 


1980 


151 


.0125 


2.24 


0.35 


63.7 




Gesten 


1982 


25 


. 10 


1 .28 


0.47 


66.9 


ns 


McClure 
et al . 


1978 


185 


.025 


1 .96 


0.38 


64 .8 




Sharp 


1981 


15 


. 10 


1 .28 


0.55 


67.3 




Shure & 
Spivack 


1977 


17 


.025 


1.96 




^82.6 




Shure & 
Spivack 


1982 


92 


.00025 


3.48 


0.75 


77.3 




Weisaberg 
et al . 


1981 


563 


.00025 


3.48 


0.32 


62.5 




Weissberg 
et al . 


1981 


243 


.50 


0.00 


0.00 


50.0 


na 



a 

Direction: = consistent with hypothesis 

ns = non-significant difference between groups 
- = not consistent with hypothesis 
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Table 7 

Suininari!:_Statistics2 i9y0^5EY_Cgndi tigns 

Condition N d ^ F 

study a.d. 

AGE 
H 

1 

Early 9 0.77 0.62 0.009 

Late 2 0.73 0.17 

H 

2 

E«rly 8 0.85 0.60 0.443 

Late 10 0.67 0.57 

H , H , H 

3 4 5 

Early 9 0T4I Id . 32 0.216 

Late 13 0.39 0.35 

DEPENDENT MEASURE 

H 

2 « » 

Alternative 17 0.93 0.54 3.43 

Consequential 6 0 . 32 O . 60 

Means-End 5 0.49 0.48 

SOURCE 

H 

1 » » » 

Hahnemann 4 1.38 0.29 6.99 

Detroit 3 0.19 0.08 

25 
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Condition 



N 



study 



ad 



Rochester 

Other 
SOURCE 
H 

2 

Hahnemann 

Detroit 

Rochester 

UConn 

Other 

H , H , H 

3 4 5 

Ha hnema rux . 

Detroit 

Rochester 

UConn 

SUBJECTS 

H 

2 

Aberrant 
Adjusted 



1 

3 



4 

2 
3 
4 
5 



4 
9 
4 



4 
4 



0.61 
0.38 



1 .26 
0.39 
1 .03 
0.48 
0.56 

0.71 
0.28 
0.38 
0.24 



1 .55 
0.67 



0.37 
0.59 



0.63 
0.03 
0.80 
0.58 
0.09 

0.28 
0.23 
0.39 
0.26 



0.92 



1 .92 



1 .47 



1 .42 



1 . 16 

(table continued ) 



9 < .11 

t 

e < .05 

E < '01 

9 < .004 
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Condition 



N 



study 



sd 



LENGTH OF TRAINING 
K 

2 

Long 
Short ' 



9 
7 



0.98 0.67 2.90 

0.49 0.40 



Long 
Short 



4 

2 



0.64 O. 18 33.28 

-0.29 0.20 
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